Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka stacks locally through kubectl port-forward, in Docker #267

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

solsson
Copy link
Contributor

@solsson solsson commented Apr 28, 2019

Started as a CI experiment, but looked promising enough for all kinds of experiments with different Kafka stacks. Builds upon #253 #266. For example we could automate Prometheus setup and evaluate #259 with Grafana dashboard.

On my machine it takes about 2 minutes to go from nothing to a running Kafka stack. Note however that according to docker stats the kafka-control-plane container takes 2.2 GB of memory and ~50% of a CPU core. I still think it's a lot lighter than on minikube.

While this is an experiment I wanted everything contained within the dockerfile, hence the odd documentation/script setup.

@solsson
Copy link
Contributor Author

solsson commented Apr 28, 2019

First automated build solsson/kubernetes-kafka:kind@sha256:f15444a17ef2df1ea6d79ce063477873984bb949e935cc5ff4a46bf0c693c6dd.

@solsson
Copy link
Contributor Author

solsson commented May 1, 2019

Built sha256:65786cafa73ef7cbf44477c3e27505cb77f86f6f6f24d873e8bc8514a03159b4 with the fix for scale 1 consumer offsets replicas.

@solsson
Copy link
Contributor Author

solsson commented May 1, 2019

Actually sha256:73acc3d8cdd99a7229505f1c681eb9e6439441dff1aade589c0a3a59121e51c2 is a leaner dev stack.

solsson added a commit that referenced this pull request May 3, 2019
solsson added a commit to solsson/kafka-keyvalue that referenced this pull request May 26, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant